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CN , Abstract 



The maximum entropy technique (MENT) is used to determine the distribution func- 
tions of physical values. MENT naturally combines required maximum entropy, the prop- 



erties of a system and connection conditions in the form of restrictions imposed on the 
system. It can, therefore, be employed to statistically describe closed and open systems. 
Examples in which MENT is used to describe equilibrium and non-equilibrium states, as 
well as steady states that are far from being in thermodynamic equilibrium, are discussed. 

y—i . 

Statistical characteristics are widely used in high-energy physics to analyse experi- 
mental data []3J. A simple analytical technique is employed by estimating the entropy of 
nuclear reaction products a parameter which is sensitive to order- disorder transition, and 
provides evidence for the formation of ordered systems during a reaction 0. 

Entropy methods for simulation of processes are being increasingly applied to various 
processes [§. An example of such an approach is the study of dynamic symmetry and 



internal chaos in models of interacting bozons |4], || conducted using the maximum entropy 
technique (MENT) @. 

MENT provides an efficient tool for solving inverse problems |7j. Its application to 
^ statistical problems is promising. It is desirable, however, to test MEM for models that 

have already been proven to be reliable for statistical descriptions. In the present study, 
the applicability of MENT was tested by describing the equilibrium and non-equilibrium 
state of systems. 

The goal of a statistical description of a system is to determine the distribution func- 
tions of physical values represented by an integral image in the results of observation. 
If distribution functions are assessed only on the basis of observation data on a system, 
then, from a mathematical point of view, an incorrect inverse problem arises in which the 
requirements of the existence, uniqueness and stability of a solution are not met. The 
condition of maximum entropy makes it possible to meet this requirement automatically. 
Only one solution of the problem is selected out of all. This solution has a maximum 
entropy, is most probable and, therefore, most stable. The resultant solution is obvi- 
ously positive because the MENT estimate is in exponential form and agrees with one 
of the main properties of the distribution function — non- negativity. Other properties 
of the distribution function, e.g. normalization in MENT, can be preset as additional 
restrictions. 

The theory of MENT is based on the second law of thermodynamics which describes 
the thermodynamic equilibrium of a closed system by maximum entropy. Attempts have 
been made to generalize this principle by arguing that entropy in internal dissipative 
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processes is maximum ||. The requirement of maximum entropy, the property of a system 
and condition of connection in the form of restrictions placed on the system are naturally 
combined in MENT so that it can be used to statistically describe the equilibrium and 
non-equilibrium states of open and closed systems. 

The mathematical structure of an entropy functional is related to the type of the 
quantum statistics of a physical data carrier and the extent of filling of quantum degrees 
of freedom |7]]. The entropy functional 

N 

ff=-X)/(fli*/(o, (i) 

where /(£) is the distribution function estimate and £ is an independent variable, is 
used for fermions and bozons with a low probability of filling of energy levels, such as 
photons of incoherent electromagnetic radiation, hadrons and 7-quanta. When the filling 
of energy levels is highly probable, a different form of a functional, like the one used in 
radioastronomy or spectral analysis ||, is selected: 

N 

H = -J2^f(0 (2) 

e=i 

We will use the most common form of an entropy functional (1). 
1. Boltzman's distribution 

Let us use MENT to determine the distribution of iV-particles on the f^-levels of 
energy Ei, which has a maximum entropy, total energy E and the number of particles N 
being retained: 

K 



J2^-Ei = E 



i=i 

(3) 

K 



J2 n * = N 



i=i 



Let us formulate the problem of estimating the probability /j = ^ of finding a particle 
on level Ei as a variation problem on a conditional extremum with the Lagrange factors 
A and fi in the form: 



k / k \ / K 



-Y^fi^fi + A [NE - Y,h E i )+H 1 max - ( 4 ) 

i=i \ 1=1 / \ i=i J 

Let us equate the first variation of this relation (4) on to zero. We will then have a 
relation: 

-hif i -l-tM-XEi = (5) 
which gives an expression for probability ff. 

fi = ^exp(-XEi). (6) 
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This distribution function is identical to the Boltzman distribution function if factor A is 
understood as inverse temperature A = 1/kT, and factor // = ln(Z/e). 

The requirement of maximum entropy in a closed system with a constant number of 
particles and constant energy results in Boltzman distribution. 

2. Non-equilibrium distribution 

Let us use the MENT algorithm to describe the state of a two-level system (levels 1 
and 2) which has magnetic moment M and consists of iV-particles with magnetic moment 
m. Let us consider that a magnetic field is absent, the system is not in equilibrium and 
the magnetic moments of the particles located on levels 1 and 2 have opposite directions. 

Let /(l) and /(2) are the probabilities of finding a particle on levels 1 and 2, respec- 
tively. Equations for the complete probability and polarization P of the system will be 
regarded as connection conditions: 

/(1) + /(2) = 1 (7) 

f{l)-f(2) = M/Nm = P. (8) 
To estimate /(l) and /(2), we will use a conventional MENT scheme with a functional: 
-/(l) ln/(l) - /(2) ln/(2) + - /(l) - /(2)) + A(P + /(2) - /(l)) - max. (9) 
The formulas 

-ln/(l)-l-/i-A = 

(10) 

-ln/(2) - 1 -n + A = 
obtained from condition (9) give expressions for probabilities: 

/(l) = exp(-l-//-A) 

(11) 

/(2) = exp(-l-/i + A). 

The substitution of these expressions in conditions (7) and (8) determines a relationship 
between Lagrange factors: 

exp(-l - /i)2ch(A) = 1 

(12) 

exp(-l - /i)2sh(A) = P. 

Dividing the first equation by the second one, we will have expression: 

P = th(A) (13) 

for the polarization P of the system. Comparing it with an expression for the polarization 
of the equilibrium state of a two-level system with magnetic moment M in magnetic field 
H 0: 



P = th(mH/kT) (14) 
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we conclude that taking A = mH/kT, we thus characterize a non-equilibrium state as 
quasi-equilibrium with magnetic field H which agrees with given polarization P or mag- 
netic moment M: 

H{P) = (kT/2m) ln[(l + P)/(l - P)}. (15) 

The result obtained implies that if there is a magnetic field which is switched off 
instantly, the thermodynamically equilibrium state of a two-level system becomes non- 
equilibrium and cannot change immediately. Therefore, at moments of time that are 
small in comparison with the relaxation time of the system this state is described as 
quasi-equilibrium, provided there is a magnetic field which decreases gently in magnitude. 

3. Steady states of open systems 

The steady states of open systems that are far from equilibrium are observed in many 
processes. Systems with autocatalytic chemical reactions were among the first to show 
characteristic types of behaviour of such systems, such as double stability, oscillation and 
wave generation interpreted by the mechanism of autocatalysis M . An example of such a 
reaction is Belousov-Zhabotinskys reaction with cerium sulphate Ce^SO^)?,, malonic acid 
CH 2 (COOH) 2 , potassium bromate KbrO% and ferroine that are vigorously mixed and 
supplied to reaction volume from which reaction products are simultaneously removed. 
Cerium, which catalyzes the reaction, contributes to the production of two molecules from 
one molecule of an intermediate product of Hbr0 2 : 

HBr0 2 + BrO^ + 3H + + 2Ce 3+ -> 2HBr0 2 + 2Ce 4+ + H 2 0. (16) 

In this case, the catalyst is not spent, but its valency changes. Ferroine adds a red colour 
to the solution, if there is an excess of trivalent cerium ions, and a blue colour if there is an 
excess of quadrivalent cerium ions. If the time of staying of the reagents in the reaction 
zone is too short to adjust direct and inverse reaction rates, then such phenomena as 
bistability and chemical hours (periodic alternation of bistable states with an excess of 
tri- or quadrivalent cerium ions) occur in the system. The colour of the reaction solution 
varies with a period of several minutes. If the reagents are not mixed, waves are generated 
and travel. 

To exemplify the steady states of open systems, let us discuss a simple model of 
autocatalysis || represented by two conjugate chemical reactions: 

A + 2X^3X, X&B. (17) 

The concentration of intermediate product X is accepted as the only state variable. Sub- 
stances A and B are either continuously supplied to the system or are removed from 
it, thereby providing the constancy of their concentrations a and b. Substance A is a 
catalyst. It increases the amount of intermediate product X which, at the same time, is 
transformed to substance B. 

At equilibrium, the rates of direct and inverse reactions are equal: 

kiax 2 = k 2 x 3 

(18) 

k 3 x = k 4 b. 
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This relation determines in the only manner the concentration of intermediate product x 
and the reagent concentration ratio a/b: 

k 4 b kia 
k 3 ko 

(19) 

b kik 3 

a k 2 k 4 

When a steady state is far from equilibrium, it is characterized by the balancing of the 
total effects of direct and inverse reactions in the form of a cubic equation: 

-k 2 x 3 + k x ax 2 - k 3 x + k A b = 0. (20) 

Using the conventional MENT scheme to describe such a steady state with connection 
condition (20) 

—xlnx + \(—k 2 x 3 + kidx 2 — k 3 x + k 4 ) — > max, (21) 
we come to the equation: 

In x = X(-3k 2 x 2 + 2hax - k 3 ) (22) 

which can easily be solved graphically. 

It is much more difficult now to trace a relationship between Lagrange factor A and 
concentration x because of a lack of an analytical expression. However, the characteristics 
of the process described can be determined from relation (22). This equation can have 
either one or two solutions. In the latter case, bistability exists in an open chemical 
system and the phenomenon of chemical hours can occur. In this case, the values of 
concentrations x corresponding to these states are found to be quantitatively dependent 
and obviously positive and the states are most stable in accordance with MENT. 

A relationship between Lagrange factor A, concentration x and other parameters of 
the problem can easily be shown for the case when equation (22) has one solution. The 
graphs of the logarithm in the left part and those of a parabola in the right part of the 
equation touch each other and, consequently, have a common tangent. Let us transform 
the equality of the derivatives of these functions 

- = \(-Qk 2 x + 2k ia ) (23) 

x 



into a quadratic equation: 



6k 2 \x 2 - 2k x a\x + 1=0. (24) 



Because the solution is unique, the discriminant of this quadratic equation must be equal 
to zero: 

Ak\a 2 \ 2 - 24k 2 X = 0. (25) 
Lagrange factor A can thus be expressed by the relation: 

* = % ( 26 ) 
kfa 2 
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and concentration x , which passes to a bistable mode, by the relation: 



x = w 2 (27) 

The value. It has been shown experimentally that transition to a bistable mode occurs 
before thermodynamic equilibrium sets in. 

MENT is a convenient technique for simulation of systems because it allows to use 
not only empirical but also a priori information. One can estimate the sensitivity of the 
distribution function to one or another condition. To model complex statistical systems 



on a computer, special MENT algorithms [|Tl], [12| are used. 
Conclusions 

1. MENT is an up-to-date and promising technique, which can efficiently be used to 
solve statistical problems. The MENT estimate of the distribution function agrees with 
the density properties of probability. The non-negativity property is satisfied automat- 
ically because the MENT solution has an exponential form, and normalization can be 
considered one of additional conditions observed when applying the technique. 

2. Generalizing the second law of thermodynamics for open systems, one can use 
MENT for their statistical description. 

3. When describing equilibrium and non-equilibrium states on the basis of conventional 
statistical models, MENT gives known results and new results when used to describe the 
steady states of open systems with autocatalytic reactions. 

4. A simple scheme, observation data and a priori information used as restrictions 
make MENT a convenient tool for describing and modelling various processes, including 
those in high-energy physics. 
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